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Definition 1. <A problem of optimisation is one in which 
one tries to maximise or minimise a certain quantity called the 
objective, which depends on a finite number of variables. These 
may be either independent or related to one another through 
some constraints. 
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Definition 2. A mathematical programme is an optimisation 
problem in which the objective and the constraints are given as 
functions or mathematical relationship. In other words, 


Optimise:. 27 (C4j.00.40 9) 
< 

Subject C0: -O)(Pisu2c584)< =p Os 2H 1Tyecagn 
> 


Some constraints are explicitly stated as requirements, others 
are hidden conditions. ‘These latter need to be pin-pointed 
through the study and understanding of the model and its in- 
puts. 
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Definition 3. A linear programme is a mathematical pro- 
eramme all the functions involved of which are linear. ‘This 
means that, 


Tice) = C0) oe Pee yay 
Gi(©1,---, Ln) = AL] + +++ + Ginn 
where 1 = 1,...,m and c; and aj;;, 7 = 1,...,n, are constants. 


If there is an additional restriction on the input variables that 
they be all integers, then the optimisation problem is called an 
integer programme. A mathematical programme which is not a 
linear programme is said to be nonlinear. 
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Definition 4. A quadratic programme is a mathematical pro- 
gramme in which all the constraints are linear and the objective 
function is in quadratic — which is in — 


Ca ree = De Danity + Dd 


1=1 j= 1 


where cj; and d; are constants. 
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Definition 5. A linear programme is said to be in standard 
form if all the constraints are equalities and if one feasible so- 
lution is known. In other words, our problem is now 


optimise: z= cx 


subject to: Ax =b 
with: x >0O 
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Definition 6. One may change any linear programme into 
the standard form by adding a slack variable to the left-hand 
side of a constraint of the form )/ a;;7; < bj to obtain 


n 
AjyjLi + Lp, = b; 
j= 


where p, >n and k = 1,2,.... 
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Similarly one may add a surplus variable to the right-hand side 
of a constraint of the form > a,x; > bj to obtain >} / a,jx; = 


1 
> aij j — Tq = bj 
j=] 


where gq) > n and / = 1,2,.... Next, all the slack and surplus 
variables are added to the objective function with zero coefh- 
cients. 
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Then if we add an artificial variable to the left-hand side of 
each constraint where there is no slack variable, then the znitial 
feasible solution is xy) = b, where x is the vector of slack and 
artificial variables. ‘The artificial variables are added to the 
objective function with a large negative coefficient —M. 
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Definition 7. A set of n vectors of m dimensions {v1,..., Vn} 
is said to be linearly dependent if there exist some constants 
Q1,...,Q@y, not all of which are zero, such that 


Q1Vi +--+ +AnVvn = 0 (1) 


It is said to be linearly independent if the condition in Equation 
1 imphes aj = a9 =-:-:-=aQy, = 0. 
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Theorem 1. Consider a set of nm vectors of m dimensions. If 
n >m, then the set is linearly dependent. 
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Definition 8. A vector v is called a convex combination 
of vectors vj,...,Vn if there exist some nonnegative constants 


(B1,..., Pn, where 
by +--+ + Pp =1 


such that 
Vv = 6ivi+---+Brvn 
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Definition 9. A set of m-dimensional vectors is said to be 
convex if for any two vectors belonging to the set the line seg- 
ment between them also belongs to the set. 
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Theorem 2. All points on the line segment joining any two 
vectors may be expressed as a convex combination of the two 
vectors. 
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Definition 10. A vector v is called an extreme point of a 
convex set if it can not be expressed as a convex combination 
of two other vectors in the set. 
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In other words, an extreme point of a convex set K is a point x in 
K that cannot be written as x = 0dy+(1-—0)z withO << 0<1l,y 
and zin K, and y ¥ z, that is to say, an extreme point is a point 
which is not an interior point of any line segment belonging to 


Kk. 
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An equivalent definition of an extreme point is that x is an 
extreme point of a convex set K if K\ {a} is convex. 
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Definition 11. A metric space is a non-empty set X for which 
is defined a concept of distance. ‘The distance d is called a metric 
on X, having such properties that, for any points x and y in X, 
we have d(x, y) > 0, and d(x, y) = 0 implies 


=o 
Furthermore, 
d(x, y) = dly, x) 
and 


d(x,y) < d(x, z) + d(z,y) 
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Let X be a metric space with metric d, let A be a subset of X 
and let x be any point of X. Then the distance from x to A is 
defined as 


d(x, A) = inf {d(xz,a): ae A} 


whereas the diameter of A is defined as 


d(A) = sup {d(aj, a2) : ajandag € A} 
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Then a set is said to be bounded if its diameter is finite. 


Further, let zo be a point in X and r a positive real number. 
Then the open sphere S;(xq) with centre xg and radius r is the 
subset of X defined by 


S00) Sr ed ao) | 


A point x in X is called a limit point of A if each open sphere 
centred on x contains at least one point of A different from z. 
A subset F’ of X is said to be closed if it contains all its limit 
points. 
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Definition 12. A linear space, aka a vector space, is a non- 
empty set L on which is defined two binary processes, say ad- 
dition and scalar multiplication. Addition is defined such that 
for any x, y and z in L, then x + y is again in L; 


L+Y=yYrsr 


et+t(ytz)=(e@+y)+z2 
there exists a unique tdentity element 0, aka zero element or 


the origin, such that x + 0 = x for every x; and there exists a 
unique inverse element —x for every x, such that «+ (—2) = 0. 
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Scalar multiplication is defined with regard to scalars, some 


instances of which are real and complex numbers, such that for 
any scalar a and any x and y in L, az is again in L 


a(x+y)=art+ay 
(a+ B)x =ax+ Pax 
(a8 )a = a(Bx) 


and lx = x, where 1 is the identity for scalar multiplication. 
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A normed linear space is a linear space on which is defined 
a norm, that is a function which maps each element x in the 
space to a real number ||z|| in such a manner that ||a|| > 0, and 
|x|] = 0 if and only if « = 0 


Iz + yll < [all + My 


and 
Jor|| = |a| ||x| 
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Theorem 3. A normed linear space is a metric space. 


Theorem 4. Any vector in a closed and bounded convex set 
with a finite number of extreme points can be expressed as a 
convex combinations of the extreme points. 
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Definition 13. For two vectors, that is points, x and y in R”, 
we write x > y if and only if x; > y; for alll <7 <n. A system 
of m weak linear inequalilties in n variables can be written as 
Ax > b, where A is an m X n matrix. 


A fundamental question concerning such system is whether it 
is consistent, that is to say, whether there exists some x such 


that Ax = b. 


A system may be inconsistent, or it may have a set of solutions 
which is unbounded. If we sketch our problem on a graph, we 
may see that it’s solution set is convez. 
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Theorem 5. The solution space of a set of simultaneous linear 
equations is a convex set the number of extreme points of which 
is finite. 
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Theorem 6. Let S be the set of all feasible solutions to the 
linear programme in standard form in Definition 5, in other 
words, S is the set of all vectors x that satisfy Ax = b and 
x > 0, where A is an m X n matrix. Then S' is a convex set, 
and the number of its extreme points is finite. The objective 
function attains its optimum, provided that one exists, at an 
extreme point of S. If m < n, then the extreme points of S 
have at least n — m zero components. 
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Algorithm 1 Procedure for finding basic feasible solutions. 
Input: Ax = b, A is an m X n matrix, m <n, rank A=m 
lay «+: an|<A 
(ajay +---+2nayn = b) + (Ax = b) 
for i=m-+1ton do 
t; <= 0 
endfor 
(11,...,%n) < solve xja, +---+2nay =b 
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Definition 14. ‘The s¢mplex method is a matrix procedure 
which solves linear programmes of the standard form as de- 
scribed in Definition 5 where b > O. Starting from a basic 
feasible solution xg we locate successively other basic feasible 
solutions giving better values for our objective. For minimisa- 
tion programmes the method uses Table 1, for maximisation 
programmes the same table is also used but with the sign of 
entries in the bottom row reversed. 
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Table 1 Table used for minimisation programming in sim- 
plex method. 


X() Co A b 


Cc = A —Cyb 
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Table 2 Description of the simplex method. 
while negative number exists in d do 


Locate the most negative number in the bottom row of 
the simplex table, excluding the last column. The 
column in which we find this number is called the 
work column. If more than one such column exist, 
choose one of them. 
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Find the smallest of the ratios between the elements in 
the last column and the elements in the work col- 
umn of the same row, if these latter are positive. 
The element in the work column that yields this 
smallest ratio is called the pivot element. If there 
are more than one of these, choose one. If none 
of the elements in the work column is positive, the 
programme has no solution. 
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Using elementary row operations, convert the pivot ele- 
ment to 1 and reduce all other elements in the work 
column to O. 


Replace the x-variable in the pivot row and first column 
by the x-variable in the first row and pivot column. 
This new first column then becomes the current set 
of basic variables. 


endwhile 
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The optimal solution is one in which all the basic variables 
assume the corresponding values in the last column, while the 
remaining variables are zero. The optimal value of the objective 
function is then the value of the last row and last column for a 
maximisation programme, and the negative of this value if the 
programme is one of minimisation. 
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Algorithm 2 Algorithm for the simplex procedure. 
7-0 
while there exists a negative number in d do 
ee hee! 
for 1=1 to n do 
{c’s} + (column no. of the most negative no. in the bottom row) 
(work column) «+ choose one of the {c}’s 
k < (work column) 
endfor 
Dxicis— . 
ce] 0 
soln «+ 0 
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for i= 1 tom do 
if (a;),, > 0 then 
soln <— 1 
p+ tay: 
J ik 
if P< Ppivor then 
rei 
endif 
endif 
endfor 
if soln = 0 then 
no solutions exist 


endif 
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convert} A, such that (a;),, = 1 and (a;), =0,1<i<m,iFr 
(Xo), — @r 
endwhile 
for 1= 1 to m do 
(x)' = (by), 
endfor 
for i=m-+1 ton do 
i A= 0 
endfor 
a xe; 
if the programme is one of minimisation then 
Sie ee 
endif 
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Definition 15. ‘The two-phase method is a procedure modi- 
fled from the simplex method to cope with cases when artificial 
variables exist in the initial solution xg, in order to minimise 
the round-off errors that occur in the calculation. The last row 
in ‘Table 1 in this case is 


d=c!' —@A= d, + Mdo 


and consequently we have ‘Table 3 which is used here. Algorithm 
2 is then firstly applied to the last row, and then again to those 
elements directly above the zeros in that row. 
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When an artificial variable is removed from the first column 
of the table, it ceases to be basic and may be removed from the 
top row of the table together with the entire column under it. 
When the last row contains only zeros, it may be deleted from 
the table. ‘he programme has no solution if non-zero artificial 
variables are present in the final basic set. 
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Table 1 Table used for minimisation programming using 
the two-phase method. 


xf 
cl 

x0) Co A b 
dy —cib 
dy 
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Definition 16. Given a linear programme in the variables 
L1,...,Xn, there exists another linear programme associated 
with it, called its dual, which is in the variables wj,..., wy. 
The original programme is called the primal. ‘The primal com- 
pletely determines the form of its dual. 
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The symmetric dual of a primal linear programme in the ma- 
trix form 
minimise: z=c x 
subject to: Ax >b 
with: x >0O 
is the linear programme 


maximise: z— b/w 
subject to: A'w<c 
with: w->0O 


The dual variables w1,..., Wm, are known as shadow costs. 
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The unsymmetric dual of the primal 
minimise: z=c x 
subject to: Ax =b 
with: x >0O 
is 
maximise: z= b/w 
subject. to: A'w<ec 
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The unsymmetric dual of the primal 


maximise: 2%7=C xX 
subject to: Ax =b 
with: x >0O 
is 
minimise: z— b/w 
subject to: A'w>c 
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Note 1. We may see from Definition 16 that the dual of 
a programme in standard form is not itself in standard form. 
These duals are said to be unsymmetric. 
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Theorem 7. If an optimal solution exists for either the pri- 
mal or the dual programme, then the other programme also has 
an optimal solution. If the duality is symmetric, then the two 
functions have the same optimal value. If the duality if unsym- 
metric, then the optimal value of each function can be derived 
from that of the other. 
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